Feb 15
24

Google Crawling Your Robots.txt File?

A fairly common question I see in the support forums is why is Google crawling my robots.txt file. Today I spotted a thread from a webmaster in the Google Webmaster Help forums where Google was crawling the mobile version of the robots.txt file, which does not exist…

Go here to read the rest:
Google Crawling Your Robots.txt File?

This entry was posted on 2015/02/24 at 2:15 am. You can follow any responses to this entry through the RSS 2.0 feed. Responses are currently closed, but you can trackback from your own site.

Posted in SEO by admin No Comments Yet

Comments are closed.